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ABSTRACT 

This study analyzes statistics of 17 public services 
units of the Oniversity of Colorado at Boulder libraries, measuring 
fr=qu>ncy of question-asking, types of questions and staff 
resoonsibility. The study seeks to determine fluctuations of 
reference service workloads over time, Jepartment staffing ani 
training needs, and to provide supervisors with a zvantifiabl> 
unierstaniing of reference activities. Over 500,00) transactions 
occurred in 1975-1976, suggesting succ2ssful marketing of services. 
Volumes of directional and circulation questions injiicate a need for 
dircctional signs and for 2xamination df circulation proceduro-s in 
some Jepartments. The success of user 2iucation programs is ceflectel 
in a high volume of instructional and cesearch questions. Stuilents 
ani support staff handle large numbers of questions with stuilants 
answering all types, indicating a need to examine staffing patterns. 
Public service librarians recommend: (lL) establishing a training 
program for students and a higher job level for students workina 
we2k>nis and evenings; (?) creating half time graduate assistantships 
with subject expertise for refersnce services on weekends ani 
evenings; and (3) converting s>veral student positions to a full-tim> 
etaff oosition. Question recording forms and question type 
Gefinitions are apperded. (KP) 
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This study analyzes the reference statistics kept by 
17 Public Services units of the Libraries on the Boulder Campus of 
the University of Colorado during 1975-1976. All Public Services 
departments were asked to maintain statistics for seven representative 
weeks during the 1975-1976 fiscal year in order to measure the 
.frequency of question-asking, the types of questions asked and the 
level of staff response. (The data gathering forms and definitions 
of question types are provided in Appendices A, B, C.) Answer quality 
was not measured. 

The reasons for this study and the on-going counting of 
reference questions at the University of Colorado at Boulder are: 

a. to demonstrate over a period of years the increase 
(or decrease) of work loads as pertaining to reference services 
provided collectively and individually by Public Services units. 

b. to understand departmental staffing and training 
needs by who is answering what type of questions. 


c. to counteract intra and extramural ignorance of what 


librarians do. 

dad. to provide supervisors with a quantifiable understanding 
of the reference activities within cach segment of the Public Services 
Division. 

The total volume (547,245) of questions handled by 
reporting departments is illustrated in Table I. The relative results 
in this table have been compared with the 1973* analysis and in most 


cases Similarities of performance held up between the two studies. 


*Composite Report on Reference Questions Asked in Public Services 
Departments." Prepared by John Lubans, Jr., October 30, 1975. Jarious 
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Library 


Circulation 

Reference 

_ Reference Desk 
Information Desk 
Public Catalog Desk 

Business 

Art and Architecture 

Science 

Goverment Documents 

Audio-Visual/Reserve 

Math-Physics 

College 

Music 

Education 

Engineering 

Interlibrary Loan 

Earth Science 

Mi croforms 

Western History 


Map 


TOTAL: 


TABLE I 


1975-76 


Volume Rank 


1975-76 
Sample 


18,123 
10,877 


(6, 344 
2,948 


1,585) 


6,108 
6,067 
5,950 
3,759 
3,755 
3,573 
2,917 
2,816 
2,581 
2,218 
2,194 
1,382 

956 

502 


175 


1975-76 


x7.4 Annual Fiqure 


134,110 
80,489 
(46,945 
21,815 

11,729) 
45,199 
44,895 
44,030 
27,816 
27,787 
26,440 
21,585 
20,838 
19,099 
16,413 
16,235 
10,226 
7,074 
3,714 


1,295 


547,245 
=a 
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. PY is 
No differentiation by type of question has been made in thie’ Tabis, 
hence the Circulation Department ranks first with 134,110 including 
a large volume (ca. 59,000 of total) of circulation-type questions 
answered. 

In addition, Table I's paniing does not Raided number 
of staff actively involved in information service or the number of 


hours such service is provided and, of course, neither is the quality 


of the answer considered. 


; That over a half-million® reference transaction occurred 
during 19-76 would appear to suggest a successful "marketing" of 
our services. Generally, the user approaches us and asks for assistance. 
The volume of interaction strongly suggests that many users expect 
to receive answers and are not fearful of library staff. This comment 
on the user's expectations is based on many nies surveys that conclude 
users are unwilling to ask for assistance for several reasons, including 
unawareness of services, not wishing to admit ignorance, and some sense 


of shyness. Lacking national comparisons of reference volume, it is 


*Regarding the overall total, which is four times that of any 
other state-supported institution in Colorado on a per staff member 
basis, it is the consensus of the reporting departments that for the 
most part the figures are on the low side due to individuals forgetting 
to record transactions due to the pressure of numerous questions 
being handled almost simultaneously at times. 
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difficult to numerically rank this Library versus other universities 
of this size. Subjective observation has it that we are substantially 
ahead of most in providing reference service. 

Table II, in percentages, shows the relative frequency ’ 
of different types of questions asked in each reporting unit. In the 
Directional column, as expected and planed Circulation and the In- 
formation desks are handling 45% and 41% each in the Aicuawlansa 
category of all questions asked of them. Likely because of their 
location near user traffic lanes, Interlibrary Loan, College, and 
Education did significant amounts of answering questions of a 
directional nature (44%, 37% and 37%). The new building (completed 
January 1977 with a relocated entrance) and renovation of the old 
(completed February 1978) should have an effect on the frequency 
of this type of question, especially in Interlibrary Loan, and some- 
what in Education and College because of new traffic Patterns. 

The Reference desk counts directional questions as only 
_ 15% of its workload which can, no doubt, be attributed to the initial ‘ 
screening of questions by the Information and Circulation desks. 

Since the Reference Desk is staffed almost ‘exclusively by lineastenes: 
this initial screening or interception of questions benefits the 


library in the appropriate use of reference librarians for higher { 


levels of questions. 
The median and average for this category are both at 30%. 
It is difficult to imply any meaning foi those units far above or far 


below the 30th percentile. The directional type question usually is 


atelier ae ee oe eee “" rs OE ae ee ee ae ee see 


Library 


Art and Architecture 
Audio-Visual/Reserve 
Business 
Circulation 
College 
Earth Science 
Education 
Engineering 
Government Documents 
Interlibrary Loan 
Map 
Math-Physics 
Microforms 
Music 
Reference 
Reference desk 
Information desk 
Public Catalog desk 
Science 


Western History 


THE MEDIAN 


THE AVERAGE 


TABIE II 


Directional Circulation Instructional 


.18 54 .16 
.21 144 » 926 
ay .58 20 
£45 44 et 
.37 115 £43 
.30 a3 , (24 
37 .29 - 32 
£29 .39 33 
.18 93 .35 
144 .48 . 06 
32 .32 20 
531 23a £10 
£23 .18 a7 
is (33 124 
s15 at £45 
#1 22 36 
30 114 145 
.34 37 24 
.09 . 46 13 
. 30 "33 Say 
30 .39 22 
= Hie 
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a result of proximity to traffic areas, especially the main entrance 


or in an area in the bookstacks where there was heavy user traffic 
past the Interlibrary Loan office, simply because of its location. 
It is interesting to note that the four science branch libraries 
are all at or near the median for this type of question. 

It is probably this type of question that is or could 
be affected considerably by the effective use of signs and other 
graphics ai.d by assuring a convenient (to the user) location of the 
information service point. 

The Circulation question accounts for a large proportion 
af questions, understandably in some units such as Interlibrary Loan, 
Circulation, and Audio-Visual/Reserve (each at 44%) but not so 
obviously in such branch units as Art and Architecture (54%), Business 
(58%), and Math-Physics (52%). It is hoped that confusion between 
what a circulation question is as compared to a reserve book trans- 
action is no longer being made, (for which see definitions in 
Appendix B). 

The median figure for the circulat’on category is 33% 
and 39% is the average. Any unit greatly above the median should 
carefully examine its circulation procedures - it makes little sense 
that circulation type questions (generally of a purely mechanical 
sort) should be taking up over half the total number of questions 


reported by a unit. It should be further stressed that”a straight 


forward reserve book transaction is not a circulation question. 
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The Instructional answer is one’ of the two, substantive 


levels of questions requiring subject expertise and knowledge in the 
use of a wide variety of both general and specific reference sources: 


dictionaries, encyclopedias, handbooks, indexes and abstracts, and 


many other bibliographic aids. Instructional questions were at a 
high in these areas: 45% in Reference; 45% at the Card Catalog desk; 


57% in Microfilms (use of equipment); 43% in Céllege and 35% in 


Government Documents. A level such as those reported appears 
desirable and even expected for these units. 

Slightly over 1/5 (22%) is the median and also the 
average for the instructional column. This type of question has the 
potential for either decreasing or increasing depending on the success 
and stress of the libraries' instructional efforts towards better 
information resource use by our users. I would guess that the more 
aware a user is of the potential services in our libraries the more 
likely he or she will ask for assistance at the instructional and 
research levels. This is often an important achievement of our user education/ 
instructional program; i.e., the user's becoming aware that it is 

-not wrong to ask for help, regardless of their status or the level 
of the inquiry. 

Research questions are the most complex and advanced 
questions asked of library staff. The research column reflects that 
this is the area of least (in quantity) activity in our service 
function with a median of 11% and an average of 8%. Exceptions to 
the median appear in Western History at 33% and Government Documents 


at 24%, 9 


i at 
dag sf ms bagi eae «ft 


a we 


Bas Zt rh yt Sa ture io O hy bie ya Poy 


- §- #4 


As with the instructional category, the asking of research 
type questions is stressed in our instruction activities. Its the 
research type of question that often results in major assistance to 
a student or faculty member's scholarly work. The librarian's special 


training and educationaT-kackground has been thought for several years, 


to be essential in this area. Any improvement in the volume of this 


‘ 
‘fe 


activity would appear to be indicative of the increasing acceptance 


, Of library information service by our users. Also, an increase for 


this category would suggest user satisfaction with this service. 
“Table III shows in percentages the volume of questions 
answered in each unit by type of staff: librarian, support staff, 
student. Also, the actual "raw" unextrapolated number of questions 
for each staff group is presented. This Table raises some questions 
as to how often librarians are involved in negotiating questions at 
all levels. In addtion, we need to examine the high volume of 
reference questions being handled by students. They answer 40% in the 
median for all units, with 36% of all questions asked. From a high of | 
100% in Maps, 79% in Art and Architecture; 70% in Business; and 59% in 
Engineering to a low of 10% in Reference and 29% in Circulation. My 
and other librarians' administrative concerns deal with the library 
training and supervision of these students answering such a hiyh 
volume of questions (205,401 during 1975/1976) as well as our having 
a very real concern over the quality of the answer. If we are content 
with this quality of assistance are we negating the advanced training/ 


experience most library faculty and library staff have? ® ; 


- Library Librarian ° 
% 
Art and Pech ene tigi 03 
Audio-Visual/Reserve 16 
Business : 5 
Circulation 1 
College 34 
Earth Science 34 
ae ae 12 
, Engineering 10 
Government Documents 7 
Interlibrary Loan Li 
Map : -0- 
Math-Physics 8 
Microforms , 4 
Music 20 
Re ference 
Reference desk 74 
Public Catalog desk’* 100 
Information desk 
Science 3 
Western History 4 
THE MEDIAN: 10% 
THE AVERAGE: 15% 


Number 


i9t 


22 


Staff 


% 


18 


32 


25 


70 


26 


30 


52 


31 


57 


89. 


aOw 


44 


50 


40 


16 


100 


62 


66 


11,124 (82,317) 44% 


Number 


1,094 
1,185 
1,551 
12,792 
745 
“413 
1,349 
693 
2,158 
1,945 
-0- 
1,581 
483 


1,127 


987 
2,948 
3,687 


331 


10 


35 


30 


35,069 (259,510) 40% 


Number Raw Total 
4,780 6,067 
1,957 3,755 
4,248 6,108 
5,202 18,123 
1,165 2,917 
497 1, 382 
913 2,581 
* 
1,314 2,218 
beads. 3,759 

‘ 

-0- 2,194 
175 175 
1,696 4,573 
439° 956 
1,140 2,816 
653 6,344 
1,585 
2,948 
2,086 5,950 
149 ‘ any 
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The volume of reference questicns (259,510) intercepted 
by support staff is a positive factor. In most of our Public Services 
Departments, support staff working with users are experienced and 
well qualified to be of assistance. This group handles the largest 
share of reference work with an overall average of 47% of the total. 
Whether such a high share of the reference work load is as it should 
= needs to be examined; a preliminary observation might be that 
based on staff numbers and administrative pressures on a department 
head's time this work load is unavailable. However, given that, we 
are faced with the ongoing need to train and develop new and old staff 
adequately to meet the reference workload. : 

The median in the "librarian" column is at; 10% with the 
overall average at 15%. Taking ern the saeioes demands of 
administration, supervision and book selection in most of our single 
librarian units, it is not difficult to see why the overall total 
(82,317 questions) would be relatively less than for the figures for 
staff and students. However, it is unsettling to see such wide 
fluctuation of availability of the librarian for information service 
of 4 ee from 3% to 34% of the total volume of questions. Even 
with the differences in the raw numbers for each unit, it is still a 
question for discussion as to how (or if) librarians with experiencé 
and subject learning can become more available for information service. 

Table III-A further emphasizes the seriousness of the 
situation. Students answer numerous questions in all question 


categories, not just directional and circulation. One can argue that 


due to low levels of staffing of both faculty and staff positions in 
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TABLE III-A 
All Libraries 


Average percentage of questions answered by type of question 
, and employee level. 


“\ 
Librarian Staff Student 
Directional 13.6 40.7 §1.1 
Circulation ; 10.5 44.6 48.8 
Instructional 20.6 41.3 44.7 


Research 22.6 34.3 36.6 
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the libraries and the long hours library units are open, it is 
necessary for students to assume considerable and sophisticated 
proportions of the question volume. This, no doubt, contributes 
to the situation at the University of Colorado with traditionally 
low staffing patterns;.nevertheless, there is a need ae Giasey 
examine our staffing patterns and the training and supervision of 
students at all hours that a library is open. Within the Public 
Services Division during 1977, we should strive to examine the 
quality of the answer provided and the establishment of a minimal 
pesttinle program for student assistants in reference work. Also, 
we need to develop alternate patterns of staffing to adequately 


provide for supervision of students working independently evenings 
‘ t 


‘and weekends in our Public Services departments. 


Discussion and recommendations stemming from March 29, 
1977 meeting of Public Services Librarians to discuss the March 10 
draft of this report. 

These quotations are from responses to the draft report 
and some of its findings: 


How can we expect. . .that a student can be 
equipped to handle the reference desk? I think 
any ‘honest reference librarian would admit that 
it takes at least a couple years of experience, 
in addition to the library school training (or ., 
its equivalent), to feel really at ease and 
competent with a card catalog and a reference 
collection. Are we discrediting this training 
and experience in suygyesliny Lhat a student is 
competent to replace us? 
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Experience tells me that it is impossible to 
set a student down at a reference desk and expect 
| him, upon instruction, to stay out of reference 
. and research questions. He is put into a position 
where he is certain to be asked the entire range 
P of questions. Not only does he not have the knowledge, 
skill, and experience to handle them but he does not 
have the judgment to know his own limitations. As I 
think hard about it, I must admit that if I were a 
x student put in that same situation I would probably 
: respond in like manner. Yet, we compound our 
difficulties by letting the student do the screening 
and determine what he will refer to us, rather than 
using our judgment to. screen what the student might 
} be able to handle. 


Joan Mason - Reference Librarian 


Student workers and staff members will continue to 
be the most visible library people to the public.: 

Every effort, therefore, should be made to itprove 
the knowledge and skills of these employees. ' The 

orientation given to new student and staff — 
should be thoroughly reviewed. 


e 


Most importantly, student workers and staff must 
be instructed as to what levels and tyves of 
questions they are to attempt to respond to and 
precisely when the appropriate answer to a patron 
would be to refer the patron to the librarian. 
The distinction between librarian, staff member, 
and student worker must be emphasized to all who 
use the“Tibrary. 


Steven Wecker - Business Librarian 


As revealed by the tone and sense of these observations 
and the diseuewicn at the meeting, there is general concern amongst 
the Public Services Librarians about the quality of reference service, 
staffing patterns, and the adequacy of training of student assistants 
to be able to answer, discriminate and refer questions to dippeet 


’ 


staff and librarians. 
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It was recommended at this meeting that the following ‘be 
explored by the Library Administration (the asterisk item is being 
eka’ on): : 

* - establishment of a training program for the library's 
student assistants working in information service. General consensus 
was that quality of student answers wena very likely be questionable. 

- establishment of an additional job level (at higher 
salary) for students ‘solely eee for libraries on weekends and 
seein, This would recognize responsibility and retain experienced 
students, rather than losing them to,higher paying non-library jobs. . 

- creation’ of a series of half-time penton (i.e. graduate 
assistantshi;s) with subject rer ren ee salary level with sole ; 
function of reference service on eveninis and weekends. (Will require 
extensive training and supervision by department head.) . 


u 


“ ~- consideration be given to converting all student 
assistant viel’ ea in favor of fulltime staff (seen as politically 
impossible); but perhaps conversion of several student assistant 


positions to fulltime staff could be achieved. 
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‘APPENDIX A 


,? —_ r 
; . Week of 19 ¢ 
\ Month/day . 
UNIVERSITY OF COLORADO LIBRARIES ~ PUBLIC SERVICES DIVISION Status of Individual Reporting ; 
\ /_d Vibrarien /_. J Seat 
; _ Litrary Reporte on Reference Questions / = Student im Other 
Directions: 1. Enter in one mark (/) for each question (see over for deftaition of type of question). ‘ 
2. Summarize and return to Library Adainistration Office a wens of week. . 
Fype of Queation| Tuesday | Thureda , Frida ote 
~~ ry A hiciel oes | 


ae eel 0 ys 
** 
Yostructional 


Totals 


we , tad 


aw | 


as | 
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APPENDIX B 
BEFINLTION OF TYVE OF QUESTIONS oe 


: . 


Includes, quest fons anwered sabaut Jd lopation of ere people or 
places; quenthoas which de not require the anterpretation of Library service and 
do not include cven the simplest tools, 


Some examples: of Directional questions: 


1. “Where's the pencil ahaeprercr” 
2. “Where can I find en. aeeg "or "where is the Adainistration Office?’ 


3. “Where's the Business, Library?’ 


. 
% 
y 


Circulation: rs 

' A. Includes negotiating requests for materials anaceessible to the 
user; on Reserve, in Realy vefercnce or in offacns, files, ok Note that the 
user docs not huve enough intursation to ask for the item by nume or sare ether 
Fositive way and requires that tne Jibrary .taflf member qucetion the user to 
identify the item the user really wants. (fo no record in this catcyory coutine 
reserve beck recuestn or other reeuests which require no other action than locating 
the iten and handing it to the user.) 


- RB. Includes questions which require the consulting of an internal file 
not open to the public, such as the Kardex, process file, shelf List, cirevlation§ . 
file, bindery file, etc., concerning a specifically requfsted library resource. 


é C. Includes questions thich require aa answer iy terns of the library 
rules. - ee 


~ Some examples of Circulation questions: * 


> 1. "Do you have Prof, 's book on geserve?" 
4 £ “Is the alzanac behind the desk?" 
4 * 3. “Can I take out this periodical!” : 

o 4. “Will you trace (recall) this book for ne?" : 

5. “Can I take this’ to Xerox?" ¥ 
i , 6 “Can you put this book on reserve for ne?" 

7. "Chere do I return books?" ” ; : _s 

8. "I got this notice of a fine) . ." , : a 

9. "Will you order . . .? It's hot in the card catalug?" ¢ 

t Po 4 


Instructional: ‘ 


* Questions which require -tcaching the use of a common tool ts one’s own 


departcent, i.c., SBC, indexes, catalogs, the card cataleg, etc. This includes in- 
struction in the use of AV equiprent, nicrorgaders, or the Locator in CD. (When not 

. used in an instructional way, @.g. when, answering a telephone query, the Locator 
should be recorded in the Circulation box). 


Sone examples of Instructional quest fons: 7 a: 
1. "I have a title but. po author; how do I find the book?” 
2. “How do I find (naze of rAgazine)?" r 
3. "I need articles on Watergate." 
4. “Ilow do I use the microfilm machine?” 
5. “I've never used a copying machine before.” 
. Research: . 
+ More complicated than an instructional question, answering the Research 
question should include the ase of more than one tool. The question will Jead to 
the use of lesser known as well as rore specialized tools. 4 


Some cxanples of Research questions: ‘ 


1. “I have to do a paper on tho, Black Mole theory. " 


2.0 "Sy erm paper as on participatory Fanage ment. . 
; 3. “I'm doing a biography of B.F. Skinner." . 
Please note: Referral questions ray fit into any of the four baste Palade above, and ‘ : 


‘should be Lowaitioy, arcording ‘ta the type of answer requis, cop. ' 

Directtonsl: You give directions to the user to find the location sutvices to by 
the Public Catalog or the SRC. 

Instructional: You advése the client to ro te another department, because you know 
“that che neve tab material sought is located there, 

esearch: You elite one or more specific tools ahd send the client to the place they 
can be foind. 

Cireulation: You tell the user ehere to return hia books or where to get duformat ton 

on circulation policies, 


; t 
20 
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. APPENDIX C 


\ 
Library Report on Reference Questions 


Week sen . Rag a, 


’ ‘ Research 


Libn 


